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Abstract. We present an overview of our recent work on implementable 
solutions to the Schrodinger bridge problem and their potential applica¬ 
tion to optimal transport and various generalizations. 

1 Introduction 

In a series of papers, Mikami, Thicullen and Leonard |20I21II23I24I25I have in¬ 
vestigated the connections between the optimal mass transport problem (OMT) 
and the Schrodinger bridge problem (SBP). The former may be shown to be 
the T-limit of a sequence of the latter, and thereby, SBP can be seen as a reg¬ 
ularization of the OMT. Since OMT is well-known to be challenging from a 
computational viewpoint, this observation leads to the question of whether we 
can get approximate solutions to OMT via solving a sequence of SBPs. Both 
types of problem admit a control, fluid-dynamic formulation and it is in this set¬ 
ting that the connection between the two becomes apparent. There are, however, 
several difficulties in carrying out this program: 

i) The solution of the SBP is usually not given in implementable form ; 

ii) SBP has been studied only for non degenerate, constant diffusion coefficient 
processes with control and noise entering through identical channels (this 
excludes most engineering applications); 

iii) No SBP steady-state theory; 

iv) No OMT problem with nontrivial prior. 

In the past year, we have set out to partially remedy this situation [4]-[lT]. We 
present here an overview of this work. 

2 Background 

2.1 Optimal transport 

Consider the Monge-Kantorovich (OMT) problem |28I1I29I 







where 77(/r, v) are “couplings” of p, and v, and c(x,y ) = i||x — y\\ 2 . 

If p does not give mass to sets of dimension < n — 1, by Brenier’s theorem, 
there exists a unique optimal transport plan n (Kantorovich) induced by a map T 
(Monge), where T = Vy>, <p is a convex function, 7 r = (/ x S7p)ffp, and Vpffp = 
^ where ff indicates “push-forward”. Assume from now on p(dx) = po(x)dx, 
v(dy) = pi(y)dy. The static OMT above was given a dynamical formulation by 
Benamou-Brenier in [2]: 


inf f f h\v(x,t)\\ 2 p(t,x)dtdx , 

(1) 

0>v) Jm, n Jo 2 


! + v>„) = 0 , 

(2) 

p(0,x) = p 0 (x), p{l,y) = Px{y) . 

(3) 


Proposition 1. Let p*(x,t) with t £ [0,1] and x £ IR ra , satisfy 

^ + V-(V#*) = 0, p*(x,0)=po(x) , (4) 

where if is a (viscosity) solution of the Hamilton-Jacobi equation 

^ + I||V*f = 0 (5) 

for some boundary condition if(x, 1) = ifi(x). If p*{x, 1) = p\{x), then the pair 
(p*,v*) with v*(x,t) = V-0(x,t) is a solution of flll-fjl. 


2.2 Schrodinger bridges 


The ingredients of a Schrodinger bridge problem are the following: 


— a cloud of N independent Brownian particles, 

— an initial and a final marginal density po(x)dx and p±(y)dy, resp., 

— po and pi are not compatible with the transition mechanism 


Pi(y)^ / p{0,x,l,y)p o (x)dx 


where 


p{s,y,t,x) 


[2n(t 


s)] 2 exp 


\x - y\ 2 ' 
2{t — s) J ’ 


s <t . 


In view of the law of large numbers, particles have been transported in an unlikely 
way (N being large). Then, Schrodinger in (1931) posed the following question: 
Of the many unlikely ways in which this could have happened, which one is the 
most likely? Follmer in 1988 observed that this is a problem of large deviations of 





the empirical distribution m on path space connected through Sanov’s theorem 
to a maximum entropy problem. 

Schrodinger’s solution (bridge from po to p\ over Brownian motion) has at 
each time a density p that factors as p(x, t ) = <p(x, t)<p(x , t), where <p and (p solve 
the Schrodinger’s system 



The new evolution has drift field b(x,t) = Vip(x,t). His result extends to the 
case when the “prior” evolution is a general Markov diffusion process possibly 
with creation and killing ED- Existence and uniqueness for the Schrodinger’s 
system has been studied in particular by Beurling, Fortet, Jamison and Follmer 
I3ll8ll9ll7l , see EDED for a survey. 

The maximum entropy formulation of the Schrodinger bridge problem (SBP) 
with “prior” P is 


Minimize H(Q 1 P) = Eq log— over T>(p 0 ,pi) , 


where T> is the family of distributions on fl := C([0,1], IR”) that are equivalent to 
stationary Wiener measure W = J W x dx. It can be turned, thanks to Girsanov’s 
theorem , into a stochastic control problem see 1121131261161 with fluid dynamic 
counterpart. Here P = W e , namely stationary Wiener measure with variance e, 
in which case the problem becomes 



^ + V ■ (vp) - e -Ap = 0 


p{x 1 0) = po(x), p(y, 1) = pi{y) . 


This formulation should be compared to dD)-©- 

3 Gauss-Markov bridges 

Consider the problem in the case where the prior evolution and the marginals 
are Gaussian. In EE, the following two problems have been addressed: 


Problem 1: Find a control u, adapted to X t and minimizing 










among those which achieve the transfer 


dX t = A(t)X t dt + B{t)u{t)dt + Bi(t)dW t , 

X 0 ~ Af(0, So), X, ~jV(0,i; 1 ) . 

If the pair (A,B) is controllable (for constant A and B , this amounts to the 
matrix ( B,AB,...,A n ~ l B ) having full row rank), Problem 1 turns out to be 
always feasible (this result is highly nontrivial as the control may be “handi¬ 
capped” with respect to the effects of the noise). 

Problem 2: Find u = —Kx which minimizes J po wer(w) := E{u • u } and such 
that 

dX t = {A- BK)X t dt + B A dW f 
has 

p(x) = (27t) - "/ 2 det(H')^ 1 / 2 exp ^x'S~ l x 

as invariant probability density. 

Problem 2 may not have a solution (not all values for S can be maintained 
by state feedback). 

Sufficient conditions for optimality have been provided in Em in terms of: 

— a system of two matrix Riccati equations (Lyapunov equations if B = B\) 
in the finite horizon case. The Riccati equations are nonlinearly coupled 
through the boundary conditions. In the case where B ^ B\, which falls 
outside the classical maximum entropy problem but represents a relaxed 
version of the classical steering problem, the two equations are also dynam¬ 
ically coupled. 

— in terms of algebraic conditions for the stationary case. 

Optimal controls may be computed via semidefinite programming in both cases. 

4 Cooling for stochastic oscillators 

Cooling for micro and macro-mechanical systems consists in implementing via 
feedback a frictional force to steer the state of a thermodynamical system to a 
non equilibrium steady state with effective temperature that is lower than that of 
the heat bath. Important applications of such Brownian motors m are found in 
molecular dynamics, Atomic Force Microscopy and gravitational wave detectors 
nmsni . to name a few. 

The basic model is provided by a controlled stochastic oscillator deriving 
from the Nyquist-Johnson model of RLC electrical network with noisy resistor 
(1928) and the Ornstein-Uhlcnbeck model of physical Brownian motion (1930): 

dx(t) = v(t) dt , (8) 

dv(t) = —/3v(t) dt —— W(x(t))dt + u(x(t),v(t), t) + adW(t) , (9) 

m 

2 k/3T 

o 2 = -, Einstein’s fluctuation-dissipation relation. (10) 


m 





Here u(x,v,t) is a feedback control law and V is such that the initial value 
problem is well-posed on bounded time intervals. For u = 0, 



Let p(x, v) = C exp — and let T e g < T be a desired steady state effective 


temperature. In [5], we have studied the following two problems: 

— Efficient asymptotic steering of the system to p; 

— Efficient steering of the system from the initial condition po to p at a finite 
time t = 1. 

In both cases, we get a solution for a general system of nonlinear stochastic 
oscillators, where we allow for both potential and dissipative interactions between 
the particles, by extending the theory of the Schrodinger bridges accordingly. 

Consider the case of a scalar oscillator in a quadratic potential with Gaussian 
marginals. For a suitable choice of constants, the model is 


dx(t) = v (t)dt , 

dv[t) = —v(t)dt — x(t)dt + u(t)dt + dW(t) . 


Using the results in Hzj, through velocity feedback control the system is first 
efficiently steered to the desired state state p at time t = 1 and then maintained 
efficiently in p. This is illustrated by Figure 1 that depicts some sample paths 
and a transparent tube outlining the “3cr region” of the one-time densities. 



Fig. 1. Inertial particles: trajectories in phase space. 









5 OMT with prior 


In [91101 , we have formulated and studied a generalization of optimal transport 
problem that includes prior dynamics. It is the natural candidate for the zero- 
noise limit of SBP where the prior is a general Markovian evolution and not just 
stationary Wiener measure. In particular, in TO] we have studied the case where 
there are fewer control than state variables and Gaussian marginals and derived 
the corresponding limiting transport problem. The latter can be put in the form 
of a classical OMT with cost deriving from a Lagrangian action, where, however, 
the Lagrangian is not strictly convex with respect to the x variable. Convergence 
of solutions is proven directly. Simulations confirm that in the zero-noise limit 
the “entropic interpolation” provided by the (generalized) Schrodinger bridge 
converges to the “displacement interpolation” of the limiting OMT problem. 

In conclusion, in Mlaiioj, we have worked out a number of cases where an 
implementable form of the solution of a (possibly generalized) Schrodinger bridge 
problem can be obtained. We have also explored to some extent the connection 
between zero-noise limits of SBP and suitable reformulations of OMT prob¬ 
lems. These cases include degenerate, hypoclliptic diffusions like the Ornstein- 
Uhlenbeck model m-m- The case of differing noise and control channels which 
does not have a classical SBP counterpart has also been studied. Finally, in [7], we 
have extended the fluid-dynamic SBP theory to the case of anisotropic diffusions 
with killing, a situation where again no probabilistic counterpart is available in 
general. The new evolution is obtained by solving a suitable generalization of 
the Schrodinger bridge system. How can we solve this generalized Schrodinger 
system as well as those corresponding to problems not covered in [5161819110] ? An 
alternative powerful tool is given by iterative schemes which contract Birkhoff’s 
version of Hilbert’s metric. This is discussed in the next section. 

6 Positive contraction mappings for Schrodinger systems 

Let S be a real Banach space and K, a closed solid cone in S. That is, K is closed 
with nonempty interior and is such that /C + /C C /C, /Cfl—/C = {0} as well 
as A K. C /C for all A > 0. Define x ^ y y — x £ JC, and for x,y £ /C\{0}, 
M(x,y) := inf {A | x A Ay} and m(x,y) := sup{A | A y A x}. The Hilbert metric 
is the projective metric defined on /C\{0} by 



A map £ from S to S is said to be positive provided it takes the interior of A? 
into itself. For such a map define its projective diameter 


A(£) := sup {d H (£(x),£(y)) \ x, y G /C\{0}} 


and the contraction ratio 


ll^llif := inf {A | d H (£(x),£(y)) < A d H (x,y), for all x,y <E /C\{0}}. 








Theorem 1. (Garret Birkhoff 1957 , P. Bushell 1973) Let £ be a positive map. 
If £ is monotone and homogeneous of degree m (£(Xx) = X m £(x)), then it holds 
that 

\\£\\h < m. 

If £ is also linear, the (possibly stronger) bound also holds 

\\£\\ h = tanh(^Z\(£)). 

Consider now a Markov chain with T-step transition probabilities tt Xo ,x t 
(prior) and consider two marginal distributions po and pt, where Xq ,Xt are 
indices corresponding to initial and final states. An adaptation of Schrodinger’s 
question to this setting leads to the following Schrodinger system: 

^(0, x 0 ) = ^2 nx o x t) = £ x T )) , <^(0, x o )<£(0, x 0 ) = Po(x 0 ), 

X T 

<p(T, x T ) = ^2 7r *o,*T < 0(°! x 0 ) = £ f (<p(0, x 0 )), (p(T, x T )<p{T, x t ) = Pt( x t)- 

Xq 

It turns out that the composition of the four maps 

<£(0, x 0 ) —> <p(T, x T ) ■= £*(<p(0,x 0 )) —» <p(T, x T ) := 

<P\T, XT) 

—*■ V>(0, *o) ■= £ (<p(T, x T )) —»• (0(0, X 0 )) next := 

where division of vectors is performed componentwise, is contractive in the 
Hilbert metric. Indeed, the linear maps are non-expansive with £ strictly contrac¬ 
tive, whereas componentwise divisions are isometries (and contractive when the 
marginals have zero entries). In [4], we have obtained similar results for Kraus 
maps of statistical quantum mechanics with pure states or uniform marginals. 
The case of diffusion processes is studied in m Applications include interpola¬ 
tion of 2D images to construct a 3D model (MRI). 
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